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ABSTRACT 

The research on the demand for skills in the U.S. 
economy is split over the issue of whether technological change has 
tended to increase or decrease job skill requirements. The question 
of whether job skill requirements have been rising is important to 
public policy debates concerning the skill gap, wage inequality, and 
the changing quality of jobs. Some researchers have attempted to use 
indirect measures of skill requirements, whereas others have osed 
direct measures and have concentrated primarily on case studies. 
Neither approach is free of problems, however. A far better data 
source is job analysis. The job analysis measure developed by Hay 
Associates is similar to the Dictionary of Occupational Titles (DOT) 
measure and includes a series of variables that capture the autonomy 
and complexity of jobs with respect to areas such as know-how, 
problem solving, and accountability. The Hay technique of job 
analyses was used to study the changing skill requirements for 
production and clerical jobs. The results suggested support for 
highly significant skill increases in production jobs. The results 
for clerical jobs, on the other hand, varied significantly by 
function. Half the clerical jobs examined experienced significant 
increases in skill needs, whereas the other half experienced 
significant decreases. Appendices contain data on the Hay technique, 
a list of production job titles, and graphical analyses of eight 
jobs. (Contains 83 references.) (MN) 
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Are Skill Requirements Rising? 
Evidence from Production and Clerical Jobs 



The concept of skill reflects both the capacities and human 
capital that workers bring to jobs and the specific demands that 
individual jobs require from workers once they occupy those 
jobs. Whether the demand for skills is changing is a vitally 
important question for public policy. The answer can help 



determine the distribution of income, the extent of technologi- 
cal unemployment, and if there are skill shortages that may 
lead to a lack of competitiveness, especially in relation to other 
economies that have the valued skills in more abundance. 



Factors Shaping the Demand for Skill 



The demand for skill in the economy is derived from the 
objective requirements associated with jobs. Changes in the 
demand for skill in the economy are the result either of 
changes in the requirements associated with indi\ idual jobs or 
in the distribution of employment across jobs that have differ- 
ent skill requirements. An important theme in research on skill 
asks whether technology has an exogenous effect on skill re- 
quirements, and there is a long literature in ihe social sciences 
(most prominent in sociology) that argues that there is a natural 
trend in market economies with respect to skill requirements. 
One tradition argues that technological change has tended to 
increase skill requirements by eliminating noxious physical 
labor. The focus here is often on technological changes that are 



so massive arid inexorable that their effects on emplownent can 
be treated as exogenous. 1 Another, and perhaps equally long 
tradition, sees technological change* operating to reduce skill 
ic\cls. These arguments often assert that industrialization and 
new technologies lead to "deskilling" — a reduction in the 
breadth of skills required from workers and. in particular, a 
reduction in their control o\er the wax their jobs are performed. 2 

Especially in the 1970s, the "deskilling" research argued 
that the type of technologies used and the wax they were imple- 
mented were choice variables that management could exercise 
in wa\s that depended on the circumstances. Marglin (1971). 
for example, argued that deskilling and the subsequent reduc- 
tion in worker control was a conscious management decision 
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taken to increase control over workers and make the manage- 
ment process easier. 3 This thesis reached its most popular form 
in the work of Braverman (1974). who placed the deskilling 
argument in a general Marxist framework and extended it to 
clerical and other nonproduction jobs. 1 The early 1970s repre- 
sented perhaps the zenith of this approach as growing worker 
dissatisfaction with production jobs led to explicit public poli- 
cy acknowledgements that narrow, deskilled jobs were part of 
the cause (e.g.. Work in America [1973]). 

The upskilling tradition tends to rely on forces external to 
the organization for its explanations and changes in the distri- 
bution of employment for evidence. The deskilling tradition 
relies on forces internal to the firm (i.e.. management strategy) 
and changes within individual jobs for its explanations (see 
Attewell j 1990] for a review). 

The third literature area, more contemporary and empirical- 
ly driven, asserts explicitly that technology and ils implemen- 
tation is a choice variable, but that the choice is not always to 
reduce skill. Spenner (1983) described this research as the 
"mixed effects" position in terms of the net change it predicts 
in skill. 1 This middle position appears a priori to be the most 
sensible, given that few technologies arc so dominant that the 
decision to use them is independent of the costs of the associ- 
iited labor, and it is clearly possible to implement the same 
technology in a variety of ways in response to factor prices 
such as wages. 



The 1980s represent a particularly good period for examin- 
ing changes in skill and the competing views noted above. 
Many observers believe that events such as the OPEC oil price 
shock in 1979. the recession in 1981. domestic deregulation of 
product markets, and the rise of foreign competition combined 
in this period to produce an exceptionally large amount of 
structural change in the U.S. economy (e.g.. U.S. Congress 
[1984]). The decline of union power to resist changes (see 
Kochan. Katz. and MeKersie [1985]) and the development of 
new workplace technologies, such as computer-aided design 
and manufacturing, gave management an unprecedented op- 
portunity to react to these external pressures by restructuring 
work and employment relations. 

A new set of studies examined changes in skill in this peri- 
od and look beyond technology for their explanations. Piore 
and Sabel (1984) argue that the saturation and greater interna- 
tional competition of industrial markets has forced employers 
to find smaller market nich« < that demand quicker reactions to 
changing markets and. in turn, a more flexible workplace 
where jobs are defined more broadly and workers have greater 
control over them. The result is to create jobs with more skill, 
broadly defined. Cappelli and Sherer (1989) find a broadening 
of responsibilities in such a firm, and Uoveman (1988) finds 
evidence of a shift in manufacturing occupations toward greater 
skill that is consistent with the "flexible-specialized"" 
hypothesis/' 
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Public Policy Issues 



Whether skill requirements have been changing has heroine 
an increasingly important issue for public policy because such 
changes relate to several public policy debates. 

Skills Gap 

The notion of a skills mismatch or a "skills gap" implies that 
there will be an increase in skill requirements that cannot be 
met by the current supply of skills. It is argued that the new 
equilibrium in the labor market that will be the result of this gap 
will have undesirable consequence^ for public policy, cause 
delays in filling positions, and catalyze either increased wages 
for skilled jobs that damage competitiveness or efforts to dcskill 
jobs in order to increase the supply of applicants. Workforce 
2000 (VS. Department of Labor 1087). focused the attention of 
both employers and policymakers on the issue (if a potential 
mismatch between the skills of the labor force and the demands 
of employers in the years ahead. Complaints by employers of 
difficulties in finding workers with adequate basic skills, de- 
spite a plentiful supply of applicants, was one of the major forc- 
es that led to another Department of Labor investigation, the 
Secretary of LahorV Commission on Workforce Quality and 



l/ihor Market Efficiency (1989). A recent report by the Office of 
Technical Assessment (1990) also argues that there w ill be a 
mismatch between the existing labor force and skill require- 
ments as manufacturing, in particular, shifts to the flexible- 
specialized production techniques described by Piore and Sabel 
(198M. 

Most of these studies draw conclusions about skill require- 
ments from projections concerning changes in the distribution of 
employment across occupations. These analyses assume that the 
skill requirements of individual jobs will remain constant in the 
future: if the distribution of employment shifts toward jobs that 
have higher skill requirements, then the workforce as a whole 
will experience upskilling. V hether changes in the distribution 
of jobs was leading to more low-wage, "bad" jobs (e.g.. Blue- 
stone ami Harrison |1986|) or not (Kosters and Ross 1988) was 
one of the more hotly debated issues in the employment area. 
Workforce 2000 (U.S. Department of Labor 1987). for example, 
argues that because 1 those jobs w ith the fastest rates of grow th 
have higher-than-average skill requirements, the overall work- 
force should experience 4 upskilling. Mishel and Teixeira (1990) 
point out. however, that because these fast-growing jobs account 
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for only a small proportion of all employment, the net effect on 
overall skill requirements will be small. Howell and Wolff 
(forthcoming) find that the rate of increase in skill requirements 
as a result of an upgrading of the occupational distribution, 
while still positive, has actually declined — and will do so 
through the year 2000 — in contrast to the 1960s. This important 
research has helped redirect thinking about skill changes. 

An important assumption in using the occupational distribu- 
tion to examine skill requirements is that the skill levels of 
individual occupations will remain unchanged. A small shift in 
the composition of the workforce from technicians to engineers, 
for example, may not necessarily imply an o\erall increase in 
skill if technician jobs have 1 been significantly upskilled and 
engineer jobs deskilled. Therefore, it is also important to know 
whether the requirements of individual jobs are changing. 

Wage Inequality 

If skill requirements rise, one should expect a new. higher 
equilibrium price 1 to emerge for skilled labor, if other factors are 
equal. Changes in the wage premium associated with skill might 
therefore be interpreted as e\idence of a change in skill require- 
ments. The rise in the returns to education in the 1980s is well 
documented, especially lor white men (Levy 1988; Katz and 
Rexenga 1989; Hound and Johnson 1989: Blackburn. Bloom, 
and Freeman 1990: Murphy and Welch forthcoming). Wallace 
and Kalleberg (1982). I)a\is and llaltiwanger ( 1990). and Gro- 
shen (forthcoming) find rising wage differentials between occu- 
pations that suggest an increase in the premium for skill. 

Main ohseners arc inclined to \iew the rise of these wage 
differentials as evidence of increases in the demand for skill 
and of increases in skill requirements. But there are several 
difficulties with this interpretation, especially for the education 
differentials. Kfforts to interpret changes in the "price" of skill 
confront the identification problem because the effects of chang- 
e's in the suppK of skill cannot be ruled out. at least not without 
examination. Blackburn. Bloom, and I'Yeeman (1990) find, for 



example, that the decline in the baby boom and in college grad- 
uates contributed in the 1980s to rising wage differentials for 
college graduates. 

Bishop (1989a) also reminds us that educational credentials 
may not be comparable direct I \ over time: high school graduates 
in the 1970s had lower levels of knowledge and ability than 
graduates in prior decades. Where competency levels are de- 
clining, rises in wage differentials for education might, in part, 
reflect the need to secure workers with higher levels of educa- 
tion in order to maintain the same levels of competency." The 
fact that there are at best very limited relationships between 
higher levels of competencies, as measured by test scores in 
high schools, and either placements or wages (see Bishop 
1 1989b) for a review ) suggests that the demand for "skill." at 
least as measured by higher levels of competency in school, may 
not be the dominant explanation for rising educational differen- 
tials.* It would also be important to know whether the rising 
wage differentials associated with skilled jobs could be attribut- 
able to changes in the supply of skilled workers. In short, wage 
changes may not be the ideal measure for assessing changes in 
the demand for skill. 

Changing Quality of Jobs 

Employers might be expected to respond to a relative "skills 
gap" — manifested as greater difficulty in hiring and/or higher 
wages — by substituting capital for labor and altering the pro- 
duction function by redesigning jobs to have lower skill require- 
ments. This should expand the supply of applicants and address 
the relative shortage of skilled workers, but it also creates less 
challenging jobs that pay less. There is some recent evidence 
that employers are responding to higher wages and general 
difficulties in recruiting skilled workers by deskilling jobs.'* 
Studies like the one by the Office of Technical Assessment 
(I9 ( K)) present the worrisome possibility that the products of 
these deskilled production systems w ill not be of the quality 
necessan In compete internal ionalK. 
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Direct Measures of Skill Requirements 



There have been many attempts to use indirect measures 
of skill requirements. In addition to wage premiums, noted 
above, studies sometimes attempt to use measures of worker 
characteristics to assess whether skill requirements have 
changed. The problem with relying on measures of workers" 
credentials, skills, or human capital — defined broadly as 
measures of skill requirements — is that there is consider- 
able evidence that such worker characteristics van inde- 
pendently from the demands of jobs tV.g.. Berg [ 197()|). Most 
of the research that has examined skill requirements direct- 
ly consists of ease studies, some of which were described in 
the context of technology studies above. \\ bile such studies 
greatly advance our understanding about win changes in 
skill occur and how they lake place, it is difficult to general- 
ize from ihem to the economy as a whole. One reason is that 
the studies themselves often suggest that the results depend 
on the context (the type of technology, conditions in the 
economy and labor market, the distribution of power in the 
workplace, etc.). which implies that the historical studies, in 
particular. may not generalize well to other periods or situa- 
tions. Then* also appears to be a significant selection bias in 



main of these studies as they appear to have been selected 
in many cases because something unusual was happening. 

These difficulties suggest that aggregate data are needed 
to examine whether skill levels are changing, but finding an 
adequate source 1 for such data is difficult. \\ hat one wants 
from a measure of skill is an understanding of how the job is 
performed, and that may be difficult to convey with a single- 
item, unidimensional measure. Jobs with similar educational 
requirements, for example, can be very different, especially 
when those requirements are Framed in terms of general 
credentials, such as Inning a high school degree. Psycholo- 
gists who study job design tend to be interested in the rela- 
tionship between jobs and individual needs, so they often 
focus on aspects of jobs that are associated with those needs, 
such as autonomy and variety (e.g.. Hackman and Oldham 
[ l ( )7o|). Sociologists focus more on aspects such as autono- 
my and complexity because of their interests in issues, such 
as power, control, and relations between workers and man- 
agement (Form 1087: Spenner \ l )HX 1 WO), and these have 
been the central concepts in research on ^kill requirements. 
In order to tost these theories, a good data source should 
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provide multiple measures of job characteristics that capture 
aspects of autonomy, variety, and complexity in jobs. 

One approach for obtaining such data is to ask workers 
directly about the requirements «.f their jobs (Mueller et. ai. 
1969), but self-reports of job characteristics are problematic 
because it is well-known in the psychology literature that an 
individual's perceptions of job characteristics do not neces- 
sarily relate w r ell to actual job characteristics (see Roberts and 
Glick [1981]). Myles and Eno (1989) found that workers' self- 
reports of skill requirements in the jobs differed substantially 
from those provided by expert raters. An accurate proxy for 
skill changes must focus on the characteristics of jobs. 

The most popular data source for measuring the skill 
requirements of jobs is the U.S. Department of Labor's Dic- 
tionary of Occupational Titles (DOT), now in its fourth edi- 
tion, which is compiled by government job analysts who 
provide detailed descriptions of some 12,000 job titles, re- 
examining changes in these titles in subsequent editions, 
one can measure changes in job requirements (Horow itz and 
Herrnstadt 1966; Spenner 1979). But there may be serious 
problems associated with using the DOT in this manner. As 
Cain and Treiman (1981 ) report, it is not clear that all of the 
entries were actually reanalyzed in subsequent editions, and 
there may have been a bias toward making the reports con- 
sistent over time. Further, by itself the DOT measure only 
tells what is happening to the content of specific jobs, not 
what is happening to average skill across a workforce or an 
organization. For example, it is quite possible for a given job 
such as drafting to be substantially dcskilled by new tech- 
nology while at the same time the composition of the design 
workforce in a firm shifts from drafting jobs to higher-skilled 
engineering jobs. The overall skill level of the design func- 
tion may rise because of this shift in its composition, even 
though the skill associated with individual jobs is declining. 
Spenner (1990) offers a review of research and issues asso- 
ciated with the DOT. 



An alternative approach is to estimate skill changes by 
examining shifts in the composition of occupations in the 
economy, the approach followed by Workforce 2000 (U.S. 
Department of Labor 1987) and discussed earlier. Perhaps 
the best data source for compositional studies is the Occupa- 
tional Employment Statistics Sun>ey assembled by the Bu- 
reau of Labor Statistics (BUS). This survey examines 150 
occupations in e<?eh industry with esiablishment-level sur- 
veys and reports the shift in employment across those occu- 
pations. 10 The problem with this survey, as with all of the 
compositional studies, is the difficulty in controlling for the 
content of jobs. Although the interviewers are provided with 
common definitions of job titles, it is not obvious that the 
respondents are really using common definitions and that 
the results are reliable. For instance, if an establishment 
refers to a position as '"accountant," it is heavily biased 
toward reporting that as the title, even if the position more 
accurately fits the interviewer's definition of "bookkeeper." 

Problems of reliability can also arise within the same 
establishment over time. Perhaps the most important prob- 
lem is that job titles do not 'always accurately reflect chang- 
es in skill requirements. Job requirements may escalate or 
decline slowly and incrementally before changes become 
noticeable. Even then, formal adjustments in titles may 
occur only in the context of a complete job reevalualion for 
the entire organization, something that may occur only once 
in several years. Similarly, emplo* ees in less rigid organiza- 
tions are sometimes rewarded with "promotions" and given 
higher job titles, even though their duties remain un- 
changed. In addition to the prestige of higher titles, line 
managers may arrange such promotions to secure grade- 
based salary increases, especially when general salary in- 
creases are heing restrained. The practice is sometimes 
known in the compensation literature as "grade drift." 11 

Finally, compositional studies do not indicate whether 
there are changes in skill requirements within individual 
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jobs, which is the reverse of the problem noted above in 
using the DOT. For example, the decline in aggregate skill 
levels associated with a shift in workforce composition from 
quality control to assembly jobs may be offset if there has 
been substantial upskilling of assembly jobs. 

Spenner (1983) reviewed the research that is based on 
aggregate data, generally the DOT and workforce composi- 
tion studies and concluded that the results have been mixed: 
perhaps small upgrading of content in the form of complexi- 
ty, equivocal results for content in the form of autonomy, 
and not much change in composition. His conclusions sug- 
gest that "the poverty of quality data'' (Spenner 1983, 83) 
may be the main issue facing better estimates (.f skill changes. 



The data concerns raised above can be used to develop 
criteria for appropriate skill data. 

1. The data should focus on actual job characteristics 
and not proxies, such as worker characteristics. 

2. The measure of skill should measure the autonomy 
and complexity of jobs. 

3. The skill measure should be consistent and reliable 
across establishments and over time. 

4. The sample should be constant over time to reduce 
confounding effects. 

5. The data should capture both changes in content 
(within jobs) and in composition (across jobs). The 
data, therefore, should not be limited to individual 
jobs but ideally should examine r-ets of jobs — work- 
forces — across which substitutions can occur. 



An Alternative Data Source 



This research centers on a new data source for measuring 
skill changes that represents a substantial improvement over 
existing sources and appears to meet most of the criteria 
above. The data come from Hay Associates, the world's 
largest compensation consulting firm. Hay performs a job 
analysis (identifies the job requirements) for its clients and 
then establishes what other clients are paying for jobs with 
identical content. In the process. Hay collects data on jobs 
and their characteristics that allow an assessment of skill 
changes to be made over time. 



The measure of skill used by Hay is similar to the DOT 
measure and includes a series of variables that capture the 
autonomy and complexity of jobs (Appendix A). The sub- 
measures are grouped into three classifications: "Know 
How," which measures the capabilities, knowledge, and 
techniques needed to do the job ranked according to their 
complexity: "Prob I em-Solving," which measures how well- 
defined and predictable job tasks are; and "Accountability.* 
which measures autonomy in decision making. These mea- 
sures get at the autonomy-complexity dimension of skill that 
concerns fields such as psychology and sociology. (The Hay 
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system is described in detail in Bellak [1984].) There is 
considerable debate about the validity of any measure of 
skill — whether it should capture abstract intelligence, 
physical and social interactions, or specific employer re- 
quirements (see Levin and Rumberger [1990] for a summa- 
ry) — but the Hay measure appears to be at least as valid a 
measure as any others proposed. Further, the Hay measures 
have widespread influence on jobs in the economy as a 
whole and. in that sense, ha\e good external validity. This 
SNStem is used for over 2 million jobs in the United States, 
including those positions for most of the country's largest 
corporations, and comparisons by non-Hay firms with these 
establishments extend the influence of the Hay svstem even 
further. 

The Hay measures also appear to be reliable. They have 
been constant at Hay for decades and. more important, are 
applied consistently across establishments. Hay staff receive 
considerable training in applying the measures, they visit 
the clients, and conduct the job analysis on the jobs being 
examined: the results are then checked for reliability by a 
central office. 12 Indeed, the product that Hay ultimately sells 
its clients is the assurance 4 that its information is comparable 
over time and across organizations. 1 ■* The first three criteria 
for data outlined above — -focusing on actual job characteris- 
tics, capturing autonomy and complexity, remaining reliable 
and consistent over time — appear to have been met. The 
various skill measures are th/Mi combined into a single mea- 
sure, the job ('valuation score, which represents an aggregate 
assessment of the demands associated with the job. 11 Com- 
parison of the skill scores over time will make it possible to 
estimate changes in skill. 

Hay has complete records of the job analvses since 1 1978 
for 94 production job lilies across a sample of 93 manufac- 
turing establishments in 27 U.S. communities. The jobs in 
the sample represent 56.536 workers. The communities 
include all regions of the I niu d States and a mix of rural 



and urban areas, although the geographic distribution of the 
sample was not designed to be representative of the United 
States as a whole. The firms in the sample were selected in 
order to help establish the labor market conditions for pro- 
duction work in each of the communities. The sample is 
therefore weighted toward larger establishments because 
they employ a disproportionate percentage of the labor force. 
The average establishment in the sample has 608 production 
employees. Schmenner (1984) reports that the average man- 
ufacturing plant operating in the United States in 1979 had 
644 workers, so the size of the operations in the Hay survey 
may not be unrepresentative of the national population even 
though they may be among the larger establishments in their 
communities. The sample is distributed across industries 
and product lines in manufacturing; The firms in the sample 
are not necessarily Hay clients, although they do receive 
information from the survey in return for their participation. 
The fact that this data set is for manufacturing is particular- 
ly important, given that most of the literature on skill re- 
quirements focuses on manufacturing jobs. 

The 94 production job titles span the full range of non- 
exempt, production work that is found typically in manufac- 
turing facilities (see Appendix B for the complete list). Hay 
consultants match jobs w ith titles to ensure that they are 
substantively identical across establishments. The jobs are 
then reevaluated each year. Because each job title corre- 
sponds to a unique job evaluation score (or a very narrow 
range of scores), positions in which skill has been substan- 
tially changed over time are retitled. For example, if an 
'"Assembly 5" job has been upskilled. it becomes an 
"Assembly 6*" job. It is therefore possible to examine both 
changes in skill content and skill composition by examining 
the changes in the distribution of job titles within general 
families of jobs. There arc 10 job families that identify gen- 
eral functions or operations within the production process. 
Kor example, there arc 14 separate assembly job titles 
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within the general job family of "assembly operations" (see 
Appendix B), and by examining the distribution of assembly 
workers across those titles over time, we can see to what 
extent assembly operations have been upskilled or 
deskilled. (This approach is similar to Keefe's [1991] inter- 
esting study of machinists, which examines changes in the 
distribution of employment across machinist job titles with 
the Bureau of Labor Statistics Industry Wage Surveys to 
examine the effects of numerically controlled machines on 
skills.) We can also look at the distribution of employees 
across job families to identify the extent to which changes in 
the composition of the workforce — shifts from high-skill to 
low-skill families, for example — have led to overall skill 
level changes for the workforce as a whole. 

One important advantage of this Hay data is that because 
the job definitions are narrow and rigid, virtually all signifi- 
cant changes in skill requirements show up as measurable 
changes in job titles. This is in contrast to more broadly 
defined jobs, which may experience significant upskilling or 
deskilling before a title change occurs, severely censoring 
estimates of changes in skill and biasing estimates of skill 
changes. A related advantage of the Hay data is that it ex- 
amines the entire range of production jobs in manufacturing 
operations, making it possible to reach conclusions about 
skill changes in manufacturing production work as a whole. 

Clerical Skill Requirements 

While most of the interest and research on skill require- 
ments focuses on manufacturing firms and on production 
jobs in those firms, there has been a parallel literature that 
examines changes in skill demands for clerical jobs. This 
research is associated with the introduction of data process- 
ing technology (e.g.. Freed man f 1965|) and more recently 
with the rise of equipment that integrates functio.is — the 
automated office (see Cuiliano [ 1982]). The divisions in 
research on clerical jobs are wry similar to those noted 
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above concerning production work. Scholars such as Glenn 
and Feldberg (1982) and Crompton and Reid (1982) follow 
in the Braverman tradition of arguing that clerical jobs have 
been deskilled, while Attewell (1982) and others suggest 
that the clerical function as a whole has experienced an 
increase in skill. These differences often appear in analyses 
of the same industries (especially insurance) and turn large- 
ly on how broadly the analysis is cast — the scope of the jobs 
examined and what gets included in the definition of "skill/ 1 
Hay has collected clerical job data that are similar to the 
production data described above. Their clerical survey ex- 
amines 211 firms, located in nine different geographic re- 
gions, in jobs covering 68,058 employees. The 1978 survey 
was repeated in 1988. The job titles in this survey represent 
a range of clerical functions (excluding supervisory func- 
tions). Again, the firms are selected to help estimate average 
conditions in the labor market, so there is some bias toward 
examining larger organizations (the average firm in this 
sample has 322 clerical employees). The firms represent a 
cross-section of industries, but there was no effort to mirror 
tht 1 population of all firms. Because clerical tasks differ 
considerably across industries, the survey cannot be said to 
track developments across the entire set of clerical functions 
the way that the production survey covers the production 
process in manufacturing. Further, the nine regions are all 
urban areas, and no claim is made to generalize the results 
to the country as a whole. As with the production data, each 
of the nine job families can be seen as representing a dis- 
crete clerical function. Changes in the distribution of em- 
ployment across job titles within that function suggests 
whether average skill levels have risen or fallen. 

Drawbacks to the Data 

For reasons of confidentiality. Hay Associates will not 
release information about the characteristics of the individu- 
al companies in these surveys, nor are the responses identi- 
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fled by company. The data presented below are aggregates 
across all establishments in the surveys. It is also impossi- 
ble to disaggregate the overall job evaluation scores into 
their subcomponents — that is. to see what proportion of 
overall skill changes can be attributed to changes in autono- 
my, know-how, or responsibility. Further, information about 
establishments that dropped out of the survey before the end 
of the periods is not available. The data are. therefore, cen- 
sored, and it is impossible to tell whether, for example, es- 
tablishments that began after 1978 or those that failed 
before the end of the surveys ("births" and "deaths") have 
different skill levels than those that were in operation since 



1978. In other words, it is possible that the firms in this 
sample are different from those that were born or died dur- 
ing the period of the study. Leonard and Jacobson (1990) 
concluded, however, that births and deaths of establish- 
ments in a similar period had no effect on the distribution of 
earnings within a sample of firms — earnings were not differ- 
ent for firms existing throughout the period. Given that 
changes in the distribution of skill should change the distri- 
bution of earnings, their conclusion that births and deaths 
did not affect the distribution of earnings might be difficult 
to sustain if jobs and skill requirements in these births and 
deaths were substantially different from surviving firms. 



Analyses with the Hay Data 



Hay Associates has made available the data on produc- 
tion jobs for the years 1978 and 1 98 .H for clerical jobs 
for 1978 and 1988. This covers the period noted above that 
many believe experienced significant restructuring in the 
economy and the workplace. The most important use of this 
data is simply to see if then 1 have been changes in skill 
levels a.-> measured by Hay's job evaluation scores. 

Distributions such as those of employees across job titles 
have many different aspects, and, as a result, there are many 
different ways to compare them. Perhaps the simplest com- 
parison is whether the means are different — in this case, 
whether the average job in a job family has a higher or lower 
evaluation score than in the past. Simple* analysis of vari- 
ance 1 and difference of means lesls can be used to address 



this question hut rely on the assumption that the underlying 
populations being sampled have a normal distribution. 

It may be difficult to argue that jobs are distributed nor- 
mally across titles w ithin these job families. The distribu- 
tions are shaped by firm production functions, and there is 
no reason to believe that they will be normal. Indeed, there 
may be a presumption that the distribution is sharply 
skewed — with many workers filling the routine, unskilled 
jobs and a handful of workers in the more c« Mve, demand- 
ing jobs — associated with the pyramid shape of most organi- 
zational charts. Nonparametric methods for estimating 
differences in locations arc more appropriate here because 
they do not rely on the assumption of a normal distribution. 
These include Wilcoxon two-sample tests, which compare 



O V, O R K 1 N « 10 PAPERS 



differences in ranks between the two samples, and two- 
sample median tests, which compare the number of observa- 
tions above a common median in the two samples. 

If the sample was a true paired replicate — that is, each 
job was examined in 1978 and again in the later period — a 
Wilcoxon signed rank test would be the appropriate method. 
But it is impossible to conduct a paired-replicant test be- 
cause the data are not identified by individual firm. The 
advantage of the two-sample test is that it can be used to 
examine two samples from different populations: the two 
samples do not have to be of equal size. As with some para- 
metric statistics, the two-sample test may not be accurate if 
the two samples differ in dispersion. A dispersion test, such 



as Ansari-Bradley, should be used to examine that possibili- 
ty. The appropriate nonparametric estimator of the size of 
differences in location between samples is the Hodges- 
I^hmann estimator, which finds the median of the ranked 
set of ordered differences between the two samples. Both 
tests are computationally difficult vith data sets of this 
size — requiring 56,536 2 separate calculations in the case of 
the manufacturing data, for example. Simpler dispersion 
tests discussed in another context below suggest that the 
dispersion in the two periods is virtually identical. See Hol- 
lander and Wolfe (1973) for a guide to these nonparametric 
statistics. 1-1 



Results 



Table 1 provides a summary of the data and results. Tin* 
first column identifies the job families for both production 
and clerical jobs. The second and third columns pro\ide 
standard outputs for parametric statistics, analysis of vari- 
ance and difference of means, respectively, for the 1978 and 
1986 data (1988 for clerical jobs). The means are the aver- 
age job evaluation points for jobs in each job family: higher 
scores in 1986 suggest upskilling within the job family. 
Sample sizes are reported in the fourth column along with 
the change in size over the period, which indicates changes 
in the composition of the workforce across job families. The 
last two columns report the results of nonparametric tests. 



The X scoies arc ratios of the rank of the Y obsenations to 
its standard error. 

The results suggest support for highly significant upskill- 
ing of production jobs, with the exception of the "House- 
keeping" family (janitor-type functions). Some of the 
changes are quite large, as with "Inspection/Quality Con- 
trol" and "Material Handling." Similarly, some of the chang- 
es in the composition of the workforce are also sizable. The 
sharp dec ,ie in fc, Qualit\ Control" and "Material Handling" 
(inventor) ) jobs, for example, may be the result of job rede- 
sign efforts that try to incorporate these functions into other 
jobs. It could be that the functions that remain for workers 
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Table 1 
Change in Skill, 1978-1986 
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in quality control haw become more highly >killed as a 
result of transferring the more routine quality functions to 
other jobs. The rise of "'jusl-in-time" inventory system?*, 
which push sonic of the material handling functions off to 
suppliers. may have had a similar effect on joh> in that fami- 
ly. ''Housekeeping," which vva> not a highly->killed position 
to begin with, experienced a huge decline in employment, 
hut little change in it> >kill level, perhaps because there wa> 
not much skill variance in its lasks — not much difference 



between what was transferred by job redesign to workers in 
other function?* and what remained. 

Because the Hay data identify all production jobs in 
manufacturing, it is po>sihlc to draw >ome conclusions ai>out 
what has happened to skill levels across the entire produc- 
tion function. The average production job in 1 ( )H6 had 0.7 
more points than in l ( J7tt (i.e.. using 1 ( )78 employment as 
tin* base). On the other hand, the average worker in this 
sample was in a job in V)<\(\ that was 7. \ points higher than 
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the job held by the average worker in 1978 (i.e.. using 1986 
employment as the base). This difference is the result of a 
slight shift in the composition of the workforce toward job 
families that had larger increases in points. To put these 
figures in perspective, they represent almost half of the 
range of job titles within the largest job family ("Assem- 
bly**); it is as if every worker moved in skill level from the 
bottom of jobs in their function halfway to the lop. We know 
that under this pa\ system wages are closely related to job 
points, and growth in points should be closely related to 
growth in wages. The other interesting conclusion looking 
across job families, therefore, is that employment growth 
was slowest where wage growth (upskilling) was highest. 

The results for clerical jobs vary significantly by func- 
tion. Half of clerical jobs experienced significant upskilling 
and the other half had significant doskilling. New office 
technologies that vary by job function seem to explain the 
variance. The biggest declines in skill are for office equip- 
ment and telephone operators. The replacement of duplicat- 
ing machines with more "user-friendly" xerography 
equipment, which is typically serviced by outside vendors, 
probably contributed both to the decline of skill and em- 
ployment for office equipment operators: PBX/automated 
switchboards had the same effect on telephone operators. 
The skill le\els of typists have apparently declined with the 
introduction of word processors: the rapid decline in the 
number of typists no doubt reflects the widespread use of 
word processors by those workers who were previously sup- 
ported by typists. 10 

L'pskilling. on the other hand, does not seem as clearly 
associated with the introduction of new technologies. The 
sharpest upskilling is for customer service jobs, which ma\ 
relate to new business strategies that demand higher lc\els 
of service (e.g.. solving problems, providing a wider range of 
services) at the point of customer contact without passing 
the issues on to the bureaucracy. The exception ma\ be 



bank tellers, where the shift of their more routine functions to 
automated teller machines has left them with a higher level of 
average tasks. The fact that ledger software has automated 
some of the simpler functions that were once performed by 
clerks may have contributed to the decline in their numbers, 
but may also have left them with a higher average level of 
tasks. On balance, technological changes may have contribut- 
ed to the deskilling of the clerical function. 

It is harder to draw conclusions from overall estimates of 
changes in the distribution of skill requirements for clerical 
jobs, because unlike the production survev. not all clerical job 
functions are included in this survey, and few organizations 
are likely to have all the clerical functions listed here. Bearing 
in mind those caveats, the average job in the clerical survey 
rose only 1.2 points over the decade, while the average clerical 
worker in 1988 had a job 1.9 points higher than in 1978. The 
modest shift in employment toward higher-skilled functions 
resulted from the fact that the jobs being deskilled suffered the 
greatest job losses. 

Measures of Dispersion 

In addition to knowing what has happened to average skill 
requirements, it is interesting to see whether the dispersion of 
employment across jobs and skill requirements has changed. 
For example, has the average gone up because all jobs have 
experienced a growth in skill, or do some smaller group of jobs 
account for the change? This is especially important given the 
studies noted earlier, which find an increase in wage inequali- 
ty across skill levels: Is this driven by an increase in inequali- 
ty of skill requirements? The dispersion in employment across 
all production jobs is compared in the two periods using the 
most popular measures of dispersion — variance. Cdni coeffi- 
cient, and The^s inequality measure. Clerical jobs do not 
form a coherent hierarchy in which changes in dispersion can 
be clearK examined. The results reported in Tabic 2 suggest 
that the dispersion is virtually unchanged in the latter period. 
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Table 2 


Equality of Skill Levels, 




1070 1QOC 




All Production Job> 




1978 1986 


Mean Hay Points 


132 138 


Variance 


2378 289 1 


Theil Entropy 


.0242 .0254 


Gini Coefficient 


.1757 .1725 



How does this result square with I lie studies that find 
increasing wage inequality? An increase in the inequality of 
skill requirements would he sufficient, other things being 



equal, to produce an increase in wage inequality, but it is 
not a necessary condition for producing greater wage in- 
equality. Changes in relative wages result from the mapping 
of the demand for skill on its supply. For example, an up- 
ward shift of the entire distribution of skill requirements 
would mean that there is much less demand for jobs thp* 
were at the very bottom of the previous skill distribution; 
wages for such jobs should fall sharply and wage inequality 
should rise. 1. Indeed, the studies that find the growing wage 
inequality cited above generally conclude that this inequali- 
ty is produced largely as the result of sharp declines in 
wages for the least educated/lowest-skilled workers. 



Conclusions 



The isMieof changing ^kill Ie\els ha> suffered r rom a 
surplus of theoretical arguments and a shortage of reliable 
data. The data pre>ented abo\e pro\ide a unique natural 
experiment for examining changes in skill le\els. For pro- 
duction jobs. the\ >uggest strong evidence of upskilling in 
job requirement combined with >ome tendenc\ to shift the 
composition of employment toward job families with greater 
>k\\\ growth. Clerical jobs also >how significant changes, 
although the pattern >eems driven at the job famib le\el In 
technological change. 

One component that i> mi»ing from the above discu»ion 
is an anal\si> a> to win these change?* have taken the form 
that the\ haw\ It is difficult to explain the development 



that led to these aggregate changes where data are not avail- 
able below tin* aggregate level. It would be easier to provide 
explanations if skill patterns could be identified for individ- 
ual firms and matched to characterises of thv^e firms. Anv 
explanation must therefore be tentative. 

The production jobs examined here are typically found 
onI\ in large manufacturing operations, and they tend to 
function in an integrated fa>hion with other jol». contribut- 
ing to a common product. \\ Iier^ the-.-e firms are unionized, 
which occurs in about half of all ma'iufa.*turing operations 
in thi> period, all production jol» tend to be covered by a 
common union contract, often contra .'<•« tluit are common 
acros> many companio. A> Kccfc (1991 ) concludes, the 



FORKING 1« PAPERS 



main technological innovation in production work — numeri- 
cally controlled machines — have played a relatively minor 
role in changing the way jobs are performed. Changes in 
production jobs seem much more driven by developments in 
traditional employee relations areas — new management 
views concerning how jobs should be redesigned and the 
decline of union power that made their implementation pos- 
sible. These developments have been system-wide and may 
have produced similar changes across all job families. For 
example, the con tempo ran- effort to make all jobs in a pro- 
duction firm responsible for quality — total quality manage- 
ment — adds some inspection functions to all other job 
families and raises their skill level. 

Clerical jobs, on the other hand, occur in virtually all 
operations. The jobs tend to be performed with considerable 
autonomy: the work performed by telephone operators will 
not necessarily come in contact with the work performed by 
bookkeepers. Each of these jobs also tends to have its own 
identifiable external labor market. The standardizing effects 
of unionization were never much of a factor for these jobs. 
New theories of how to organize jobs may have had some 
effect on clerical job demands, especially on customer ser- 



vice, but many of these jobs are performed idiosyncratically 
(such as secretarial work) and do not lend themselves easily 
to traditional job redesign efforts. The important develop- 
ments in clerical work over the last decade appear to have 
been the introduction of new technology. Word processors 
and personal computers were not invented in 1978 when 
this survey began. The new clerical equipment was different 
and separate for each function, and because these functions 
are performed autonomously in separate labor markets, the 
effects of the various new clerical technologies were differ- 
ent for each job function and family. 

The fact that the upskilling of manufacturing jobs took 
place despite the findings from other studies of rising wage 
differentials for skill — that is, requirements rose even as 
prices were rising — suggests that the upskilling could not 
have been simply a response to a decline in the relative 
price of skill (i.e.. a movement along the demand function 
for skill) and must represent a shift in the demand for skill. 
This conclusion runs counter to the deskilling hypothesis 
and is consistent with hypotheses that suggest that either 
changes in the 1980s — in product markets, technology, 
management strategy — increased the demand for skill. 
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Endnotes 



l Some of these arguments can be traced to Adam Smith (1776). Argu- 
ments about the benefits to workers of technology began with the 
scientific socialists and continued, for example, in studies of eco- 
nomic development, especially in comparisons between jobs in 
industrialized and developing countries. Kerr and coworkers 
(1960), for example, saw industrialization as liberating production 
workers from oppressive physical laboi and leading to more skilled 
jobs and better working conditions. Students of industrial technolo- 
gy such as Woodward (1965) argued that assembly line work, which 
often appeared to reduce skill requirements, was only a stop on the 
road toward automated, "continuous production" factories where 
workers would be freed from machine-paced tasks. Blauner (1964) 
argued that such technologies would ac tually lead to an increase in 
skill, for example, as workers performed a broader range of moni- 
toring tasks. This thesis reaches its high point with Bell's (1973) 
arguments that know ledge-based jobs would replace production 
work in the economy of the future. 

-Adam Smith's U~76) observations about the increasing division of 
labor and the narrowing of jobs that results can also be seen as part 
of the beginning of the deskilling argument. It was developed by 
Durkheini (1964). Veblin (1914) and others who were concerned 
about the dehumanizing effects of automation and factor) produc- 
tion and the broader effects it would have on society. The ri.se of 
scientific management as a theoretical argument for deskilling and 
of assembly line production ..icthods in basic industries led to 
widespread acceptance of the deskilling argument supported by 
research findings (Walker and Guest 1952: Bright 1966) and to a 
shift in research to examine the consequences of deskiiled jobs (e.g., 
Blauner 1964). 

*One important issue in this debate is just how much of the svstein 
represents Mrategic decisions by management — decisions that were 
within their control — and bow much was driven by economic forces 
and efficiency needs. Marglin and others in this tradition argue that 
the factor) system per se was the product of a management strategy, 
although it is not necessary to go that far to argue that management 
pursued deskilling strategies when they were not necessarily effi- 
cient in a purely technological sense. 

Mn particular. Braverman argued that the shift in the distribution of 
occupations toward administrative and white collar job* was not an 
indication that overall skill levels are rising, but instead was sim- 
plv a manifestation of deskiiled production work where the "men- 
tar' aspects had been removed. 

' MoM of these studies arc cases, and many are hiMorical. Hoh>buwm 
(1964) describe?*, for example, how craft workers were able to use 
the techniques of organized labor (e.g.. controlling supply) to resist 
management efforts to deskill jobs. Kdwards. Keich. and Gordon 
(1979) suggest that changes in skill have been the result of a com- 
plex process of bargaining between management and labor. Other 
authors point to a range of em ironmcntal factors, such as product 
and labor market conditions, payment systems, management char- 



acteristics, and so forth, as helping to determine changes in skill 
(e.g., the papers in Wood 1982). Flynn's (1988) survey of hundreds 
of case studies of technological change finds considerable variance 
in the effects on employment and skill levels, lending support to 
the "mixed effects" hypothesis. 

"Other studies in this period continued to emphasize the relationship 
between technology and skill. Hirshhorn (1984) suggests an argu- 
ment similar to Bell's (1973) that new automated technologies will 
require higher-order mental and social skills from workers. On the 
deskilling side, some studies of the introduction of numerically 
controlled production machinery ha\e suggested that the introduc- 
tion of these machines is designed to reduce workers skill (Noble 
1977). Further, even where the mix of skills associated with numer- 
ically controlled jobs appea r s to grow, the changes may simply add 
more boring tasks and leave the content of the jobs degraded (Adler 
1986). Again, studies in the "mixed result/it depends" tradition 
report a variety of changes in skill across situations, depending 
typically on c ontextual issues. (See the papers in Hyman and 
Streek |1988| and Zuboff [1988] for case-based examples ami 
Kelley [1989| for a survey-based argument.) 0\erall. a National 
Academy of Sciences study (Cyert and Mow ery 1987) concluded 
that changing technology was unlikely to increase skill require- 
ments d ring the immediate future. (See Kevin and Rumberger 
1 1990] for a similar conclusion.) 

7 Blackburn. Bloom, and Freeman (1990) find, however, that the re- 
turns to education have increased even for older cohorts whose 
educational experience predates the decline in quality described 
by Bishop (1989a). This suggests that such declines cannot be the 
complete explanation for rising returns to education. 

"Blackburn and Neuniark (1991), however, find that the increase in 
returns to education has occurred largely for workers with higher 
le\els of ability (measured by test scores), which is consistent with 
the hypothesis of increasing demand for workers with high levels of 
both basic capabilities and skills. 

"Presumably, the incentiws to increase the supply of applicants by 
deskilling jobs are always present, but whether the costs offset the 
gains depend on the cost of capital and the relati\e wages for high- 
er skill. The rising wage differentials associated with skill and 
education noted above suggest that deskilling must not be the 
dominant trend in the economy, although it may have be particular- 
ly important in some sectors and may in part offset what would 
otherwise be even greater increases in skill differentials. 

"'Establishments are resiirveyed even three years, and the siiney data 
go back for nine years. The results are used to produce the Occupa- 
tional Outlook handbooks for the BLS. 

"The reliability of the Occupational Employment Statistics Surrey 
(Bureau of Labor Statistics) also suffers from the fact that il is 
actually conducted separately by each state, under t ic general 
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guidance of, hut not the control of, the BLS. The BLS takes the data 
from the i.*ates with little opportunity to check the reliability of the 
results or the methods used. 

12 The reliability tests appear to he qualitative — questioning "out- 
liers," for example, or unusual patterns in the data. 

"The incentives are clearly for Hay to he consistent over time in its 
methods. Long-term clients (the bulk of their business) know which 
of their jobs have remained constant, and it would be painfully 
obvious if Hay generated different job evaluations for those posi- 
tions over time. 

u The separate measures arc combined through use of a constant 
algorithm that weights the various measures and creates an index 
from them. Unfortunately, only the final job evaluation total is 
available (measures of the separate components were not retained), 
and it is impossible to recreate the separate component scores from 
the aggregate score. 

i:> The unit of analysis should be the individual job and the sample size 
should be the number of job? in the sample because the individual 
job is where changes in skill requirements occur. Even in the most 
narrowly defined job family (Assembly Jobs), there may be many 
different and distinct jobs that are equal in value to a job title such 
as "Assembly Level 10." Workers who assemble ignition systems 
and those assembling engine valves may both have an "Assembly 
10" title; the functions are not identical even though the skill 
requirements are the same. Even on a large-scale assembly line, it 
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